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Orthogonal systems in vector spaces over finite fields 

Alex losevich and Steve Senger 

Abstract. We prove that if a subset of the d-dimensional vector space over a finite field is large 
enough, then it contains many fc-tuples of mutually orthogonal vectors. 
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J^ , 1. Introduction 

CN , 

0^ ■ A classical set of problems in combinatorial geometry deals with the question of whether a 

^^ ' sufficiently large subset of R'^, Z'', or F^ contains a given geometric configuration. For example, a 

classical result due to Furstenberg, Katznelson and Weiss ([5]; see also [2]) says that if _B C K^ has 
r_^ I positive upper Lebesgue density, then for any (5 > 0, the ^-neighborhood of E contains a congruent 

copy of a sufficiently large dilate of every three point configuration. 
f~^ I When the size of the point set is smaller than the dimension of ambient Euclidean space, taking a 

(5- neighborhood is not necessary, as shown by Bourgain in [2] . He proves that if i? C M'* has positive 

upper density and A is a fc-simplex with k < d, then E contains a rotated and translated image of 
j^ ' every large dilate of A. The case k = d and k ~ d-\-\ remain open, however. See also, for example, 



H I [3], [4], [10], [15] and [16] on related problems and their connections with discrete analogs. 



In the geometry of the integer lattice U^ ., related problems have been recently investigated by 
Akos Magyar in [12] and [13]. In particular, he proves in [13] that if d > 2fc + 4 and E dTJ^ has 
positive upper density, then all large (depending on density of E) dilates of a fc-simplex in 1/^ can 
be embedded in E. Once again, serious difficulties arise when the size of the simplex is sufficiently 
large with respect to the ambient dimension. 

In finite field geometries a step in this direction was taken by the second and third listed 
authors in [6]. They prove that if i? C F^, the d-dimensional vector space over the finite field with 
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q elements with |-E| > Cq'^~k ^t- and A is a fc-dimcnsional simplex, then there exists r G F^ and 
O G SOdi^q) such that r + 0(A) C E. The result is only non-trivial in the range d > (2) as larger 
simplexes are out of range of the methods used. See also [8] for a thorough graph theoretic analysis 
of a more general problem. 

In this paper we ask whether a sufficiently large subset of F^, the d-dimensional vector space 
over the finite field with q elements, contains a /c-tuple of mutually orthogonal vectors. Similar 
questions, at least in the context of pairs of orthogonal vectors are studied in [1]. This problem 
does not have a direct analog in Euclidean or integer geometries because placing the set strictly 
inside {x G M'' : Xj > 0} immediately guarantees that no orthogonal vectors are present. However, 
the arithmetic of finite fields allows for a richer orthogonal structure. Our main result is the 
following. 

Theorem 1.1. Let E CW^, such that 

J k — 1 , k — 1 I 1 

\E\ > Cq'^^^+^^+T^ 
with a sufficiently large constant C > 0, where 

< (^) < d. 
Let Afc be the number of k-tuples of k mutually orthogonal vectors in E. Then 

A, = (l + o(l))|S|'=g-(=). 

1.1. Graph theoretic interpretation. Define a hyper-graph Gk{q,d) by taking its vertices 
to be the elements of F^ and connect k vertices by a hyper-edge if they are mutually orthogonal. 

Theorem 1.1 above implies that any subgraph of Gk{q,d) with more than Cq'^~^ ' ^ '"^ vertices 

contains (1 -I- o(l))|i?| g"^^-' hyper-edges, which is the statistically expected number. 

Alternatively, we can think of Theorem 1.1 as saying that any sub-graph of G2{q,d) of size 

greater than Cq'^~i^'^^ ^^ contains (1 + o{l))\E\ g^^^j complete sub-graph on k vertices, once 
again a statistically expected number. 

See [8] , and the references contained therein, for a systematic description of the properties of 
related graphs. 

1.2. Hyperplane discrepancy problem. One of the key features of the proof of this result 
is the analysis of the following discrepancy problem. Let 

H.,i,,2_,. = {y G F^ : y • x^ = J = 1, 2 . . . , fc}. 

Define the discrepancy function r^ by the equation 

\E n H,i,...,,.| = \E\q-'' + rk{x\ . . . ,x'=), 

where the first term should be viewed as the "expected" size of the intersection. In Lemma 2.1 
below we show that on average. 



\rkix\...,x'')\<^\E\q-^, 



where here, and throughout the paper, X < Y means that there exists C > 0, independent of g, 
such that X <CY. 

1.3. Acknowledgements. The authors wish to thank Boris Bukh, Seva Lev and Michael 
Krivelevich for interesting comments and conversations pertaining to this paper. 
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2. Proof of Theorem 1.1 



Observe that 



fc-i 

i=l,2....,fc-l ' 



Lemma 2.1. \\rk-i\\L^ '^ \E\2q 2 



Assuming Lemma 2.1 for now, we prove the main result, Theorem 1.1. 



Proof. Define Pfe := {{x^,...,x'^) e E'^ : x' • x-' = 0, VI < i < j < fc}, where i?*" means i? x E x ... x E^ . 

k times 

Also, let Vkix-^, ...,x'^) and E{x) be the indicator functions for the set Vk and E, respectively. 
Clearly iPfc I =Afe. 



Xk= J2 T^k^i{x\-,x''-^)E{x'') 

j=l,2,...,k 



fc-1 



= g-(^-i) J2 'Dk-iix\...,x'^-')Eix'^) Y. n^(-^'^'-^') 
x^ev^ s,eF, 4=1 

i=l,2,...,fc i=l,2,...,fc-l 

fc-1 
= 9'*'"'^ E E ^fc-i(a;\...,:r'=-l)i?(.T'^-)nx(-s.:2:'-x'=) 

1=1,2. ...,fc-l^-^12,...,fe 

= 1 + 11 + IIL 



where we seperate the sum into three parts depending on the Si's. / is the sum when all of the 
Si's are zero. // is the sum when none of the s^'s are equal to zero. /// is the sum when some of 
the Si's are equal to zero, and some arc not. We treat these three cases seperately. We will show 
that / dominates the other terms when \E\ satisfies the size condition, and is therefore the number 
of sets of k mutually orthogonal vectors present in E, modulo a constant. 
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j=l,2,....k-l 

x^eW^ 

j=l,2,...,k-l 

If / indeed dominates the other two terms, we'll have 

^^\E\q-('-'l 

To get an expression for A^., we run the computation for fc = 2 first. In this case, instead of 
Vi {x^), we'll just have E {x^)- This is because we are checking that any two orthogonal vectors in 
W^ are also in our set E. Running through the above calculation in this manner yields A2 = |i?p(7~^. 



9(2) 



Now we need to compute //, the biggest error term. Now we recall the definition of the 
discrepancy function. 



fc-i 



rfc_i {x\ ..., x^-i) = q-^"-'^ J2 E ^(^') n x(-««^' • ^') 



i=l,2,...,fc-l 



First, we dominate the sum of the x-^'s in E by the sum of x^'s in all of F^. Then we apply 
Cauchy-Schwarz to the sum over the x^ 's. 



fc-i 



// = g-(^--l) Y, E ^^k-lix\...,X>'-')E{x'')l[x{-S^x'■x'') 

i=l,2,...,k-lj=i,2,...,k 

fe-1 

< E 1'^'''^ E E ^^-i(^''-'^'"')^(^')n^(-^^^'-^') 

x'GE s,eF* x''e¥'^ «=i 

j=l,2,...,fc-l i=l,2,...,fc-l 

<aL( E rl_,)^'-\E\'-'q'^q'-'^\E\'^q^\\r,^, 



x^ ....,x^^^ 

So we use Lemma 2.1 to get a handle on ||rfc_i|[i2. Now we are guaranteed that 



ORTHOGONAL SYSTEMS IN VECTOR SPACES OVER FINITE FIELDS 



II <\E\ ^ q 2 \E\-^q 2 
^\E\^q ^^^ 



To deal with ///, break it up into sums that have the same number of non-zero Sj 's. 

Ill- E + E +••• 

one Sj— two Sj's—Q 

= dY,+did-l) J2 +■■■ 

si—O si— S2— 

Now each of these sums will look like //, but with (fc — 2) instead of (fc — 1) for the first sum, 
and (fc — 3) instead of (fc — 1) in the second sum, and so on. This allows us to bound each sum in 
/// as follows: 

III < d\E\^q^\\rk-2\\L- + d{d ^ l)\E\^q^-\\rk-3\\L- + - 
So /// is dominated by // as long as g > d, which is guaranteed, as q grows arbirtarily large. 
Now we only need to find appropriate conditions on E to ensure that / > //. 

I> II 

lElf^q-i-) > \E\^q ^-^ 

fc fc(fc-l)-2(ii-l)(fc-l) 

\E\^- > q 4 

\E\>qi'^)''+'^ + i. 

Now to prove the Lemma 2.1. 

Proof. Recall the definition of rk-i {x^, ..., x''~^) and use orthogonality in x^, ..., x''~^ . 

iir,_iiii. = g-^(^-i) E E E lix{{s,^'-^',y')-^n 

( \ 

k 



n 



^dik-l)^-2{k-l) 



J2 E ^(^')^(/) + E E Eix'^My^ 

\ SjX>'=s'^y'' sjx''=s]y'' ) 

(d-2)(fc-i) (^A + B) 



Let us approach A first. Since s\ = s'^, and SjX = s'^y for all j, we know that it holds for 



j = 1, and therefore x^ = j/'"'. This tells us that Sj = s'- for all j. So 
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Si,...,Sk-l x^ x^ 

Now we tackle the quantity B. Here we introduce new variables, a — ^ and a' ~ s' . Also 

notice that the condition SjX^ = s'.y^ implies a = |f for all j. So we did have to sum over 2(fc — 1) 

different variables, but now we know that these are completely determined by only k of the originals. 
So we will have (fc — 2) free variables. In light of this, with a simple change of variables we get 

B = q(k-2) J2 E{x'')E{ax^) 

Where, Ixk :~ {tx^ e F^' : i e F^}. which can only intersect E at most q times. With the 
estimates for A and B in tow, 

D 

3. Sharpness examples 

The following lemmata are included to show how close Theorem 1.1 is to being sharp. There 
are several possible notions of sharpness for this result. It is clearly interesting to consider how big 
a set can be without containing any orthogonal fc-tuples. The first lemma is merely an instuitive 
construction used in the next lemma, both of which concern large sets with no orthogonal /c-tuples. 
The last lemma is included to show how close our size condition is if we relax the allowable number 
of orthogonal A:-tuples. 

Lemma 3.1. There exists a set E <Z ¥'i such that \E\ « q^ , but no pair of its vectors are 
orthogonal. 

Proof. This is done by taking the union of about | lines through the origin, such that no 
two lines are perpendicular, and removing the union of their | orthogonal complements, which are 

2 

lines perpendicular to lines in the first union. Then our set E has about ^ points, but no pair has 
a zero dot product. D 



The next result is the main counterexample, which shows that it is possible to construct large 
subsets of FJ^ with no pairs of orthogonal vectors. 

Lemma 3.2. There exists a set E dWJ^ such that \E > cq'^^^ , for some c > 0, hut no pair of 
its vectors are orthogonal. 
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Proof. The basic idea is to construct two sets, Ei C F^, and £'2 C FJ^^^, such that li^il « q^ 

and \E2\ ~ (1~^~ ■ If you pick q and build these sets carefully, you can guarantee that the sum set of 
their respective dot product sets does not contain 0. The following algorithm was inspired by [7]. 

Here we will indicate how to construct Ei. The construction of E2 is similar. First, let q = p^ , 
where p is a power of a large prime. We also pick these such that p + 1 is of the form 4?!, where 
n is odd. This way we can be guaranteed a large, well-behaved multiplicative group of order 
q— 1 = (p — l)(p + 1), as well as a subfield of order p. 

Let i denote the square root of —1, which is in F* since q is congruent to 1 mod 4. Now let B 
be a cyclic subgroup of F* of order ^^(p — 1) = n{p — 1). Since n was odd, and p was congruent 
to 3 mod 4, we know that 4 does not divide the order of B. This means that B has no element of 
order 4, so it is clear that i ^ B. Let /3 denote the generator of B, as it is a subgroup of a cyclic 
group, and therefore cyclic. Since p — 1 is even, we know that we can find another cyclic subgroup, 
A, generated by /3^. Let Cp be the elements of F* that lie on the unit circle, that is, 

Cp:= {xe¥l:xl+xl = l}. 

From a lemma in [7], (or basic number theory) we know that \Cp\ = p — 1, since —1 is not a 
square in a field of order congruent to 3 mod 4. We can be sure that for all u,w G Cp,u ■ v £ ¥p. 
Now let 

E[ ■~{Tu:TeA,ue Cp} . 

So, for all x,y (z E'l, we can be sure that x ■ y G AU {0}. To see this, let x = au, and y = tv, 
where cr, r S A and u,v € Cp. Then x ■ y ~ ariu ■ v) G AU {0}, as any non-zero u ■ w e F* C A. 
Now, the cardinality of E'^ is 



\E[\ = \Cp\\A\ = {p-l^'^^^P ^ 



Now pick ^ mutually non-orthogonal lines in E^. Call this collection of lines L. Let L indicate 
the set of lines perpendicular to the lines in L. Now we need to prune E'^ so that it has no orthogonal 
vectors. One of the sets E[^ L or E[r\ L^ has more points. Call the set with more points Ei. 
This means that no zero dot products can show up in Ei , in a similar manner to the construction 
in the proof of Lemma 3.L Now we have \Ei\ ~ q'^ , and for any x,y e E'l, we are guaranteed that 
a; • y G A, which does not contain 0. 

Construct E2 C FJ^^^ in a similar manner, using spheres instead of circles. However, in the 

construction of E2, we do not need to prune anything. Now we have |i!^2| ~ q~^~ and all of its dot 
products he in ^ U {0}. Set E = Ei x i?2- Since Ei has its dot product set contained in A, and E2 
has its dot product set contained in ^ U {0}, we know that any dot product of two elements in E 
is in the sum set ^ -|- (^4 U {0}). 

Now we will show that is not in the dot product set. If two elements did have a zero dot 
product, that would mean that we had s,t € A, where s comes from the first two dimensions, or Ei, 
and t comes from the other d — 2 dimensions, or E2, and we also have s — —t. (Note, even though 
t could conceivably be zero, s can not, so we would not have s = —t ii t were zero. Therefore t 
is necessarily an element of A.) Recall that s and t are squares of elements in B. Call them cr^ 
and T^, respectively, for some cr, t G S. Since B has multiplicative inverses, let a = - G B. So we 
would need the following: 
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2 2,1" 2 

G =— T ^ —\ = ^ = a . 

T- 



But we constructed B so that it does not contain the square root of —1. Therefore there can 
be no two elements of E which have a zero dot product. D 

The authors beheve that the preceeding example can be generalized to obtain results about 
how large a set can be without containing orthogonal fc-tuples for k > 2. The next example is 
trivial, but is included to indicate one way in which we get some orthogonal vectors, but not as 
many as would be expected by initial considerations. 

Lemma 3.3. There exists a set E C F^ such that \E\ « q'^^'^-'^^+'^+i , but only q^''-^^^''-^^+'^ 
k-tuples of its vectors are orthogonal. 

Proof. A more interesting example is for any suitable d and fc, consider a set Ei C FJ^^^ that 
satisfies the size condition for d— 1 dimensions. That is, \Ei\ « g~(^('^~^'+T ^t . By Theorem 1.1, 
we know that Ei has about \E\''q^^^) w q('=-i)(''-i)+i different fc-tuples of mutually orthogonal 
vectors. If we consider E ~ Ei x {0} C F^, we have \E\ = \Ei\ « q—iri'^^'^)^ ^^"^, but we have 
only about q('=~i)(''~i)+i different fc-tuples of mutually orthogonal vectors. D 

The set constructed in Lemma 3.3 has fewer than the "statistically expected" number of mu- 
tually orthogonal vectors with respect to the dimension d. Considering only the size of the set, this 
example shows that if we lose a factor of about (j~fc~ points in our set, we lose a factor of about 
q^~^ fc-tuples of mutually orthogonal vectors. Of course, this is quite artificial, in the sense that E 
"really" lives in a smaller dimension, but it does indicate that the result is relatively sharp. This 
also points to a rather intuitive measure of dimension of a set, if one has a handle on the number 
of mutually orthogonal fc-tuples. 
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